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ON THE GROWTH RATE OF A LINEAR STOCHASTIC 
RECURSION WITH MARKOVIAN DEPENDENCE 

DAN PIRJOL AND LINGJIONG ZHU 


Abstract. We consider the linear stochastic recursion Xi+i = aiXi + bi 
where the multipliers Ui are random and have Markovian dependence 
given by the exponential of a standard Brownian motion and bi are 
i.i.d. positive random noise independent of ai. Using large deviations 
theory we study the growth rates (Lyapunov exponents) of the positive 
integer moments \q = lim„_^tx 3 MogE[(a:„)^] with q £ Z+. We show 
that the Lyapunov exponents Xq exist, under appropriate scaling of the 
model parameters, and have non-analytic behavior manifested as a phase 
transition. We study the properties of the phase transition and the 
critical exponents using both analytic and numerical methods. 


1. Introduction 

Random recursions are widely used to model processes in economics, bi¬ 
ology, computer science and physics, see e.g. [ITIdBlEalSIlES]. The best 
known is the Kesten process which is defined by the linear stochastic recur¬ 
sion [18] 

(1) Xi+i = atXi -h bi 

where ai,bi are random i.i.d. real variables with ai > 0. The distributional 
properties of this process and the conditions for the existence of stationary 
and ergodic distributions are well-known [IHlESlllel. The process ([^ has a 
unique stationary solution, provided that E[logaj] < 0 and E[log(6i)+] < oo. 
Under these conditions the stationary distribution has power-like tails (more 
precisely of regular variation) E(xn > X) ~ X~^ for X —?■ oo, where the 
exponent fi is determined by the equation E[of] = 1. See |23| for a recent 
overview of the properties of this process. 

The generalization of the process 0 to the case of random coefficients 
ai , bi with Markovian dependence has been also considered in the mathe¬ 
matical literature 1301 EH- 

In this paper we consider a linear stochastic recursion of the form 0 with 
stochastic multipliers a* following a Markov process given by the exponential 
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of a standard Brownian motion. We consider the stochastic recursion defined 
by 

(2) Xi+i = aiXi + bi, Oi = 1 + 


with initial condition xq > 0 and 6* are i.i.d. positive random variables 
independent of (aj)“Q. Wi is a standard Brownian motion sampled on 
the uniformly spaced times ti with time step tj+i — U = t and to = 0, 
i.e. Wi = W{ti), where W{t) is a standard Brownian motion starting at 0 
at time 0. The parameters cr, p € M_|_ are real positive numbers. Although 
superficially similar to the linear recursion Q, the process Q has a different 
qualitative from the Kesten process as it is non-stationary. 

For the moment, we will assume the homogeneous case = 0, and we 
consider the random multiplicative process 

(3) Xi+i = aiXi , Oi = 1 + 


The process (© under the full stated assumptions will be considered in 
Section 10.2 The process Q is a stochastic growth process with correlated 
multipliers a* > 1. It can be regarded as a discrete time version of the 
continuous-time process dXt = ^Xtdt by writing it as 


( 4 ) 


Xi+i - Xi = 


The process for Xt is solved in terms of the time integral of the geometric 
Brownian motion 

(5) Xt = Xo exp (^pj^ . 

The time integral of the geometric Brownian motion appears in many prob¬ 
lems of statistics, probability and mathematical finance, and its distribu¬ 
tional properties have been widely studied [nmEB]. We will show that 
the discrete time version Q of this process has new and interesting prop¬ 
erties, which are qualitatively different from those of the continuous time 
case. 

The process Q appears in several mathematical finance problems. For ex¬ 
ample, it describes the bank account under discrete time compounding with 
interest rates following a geometric Brownian motion. This corresponds to 
the money market account in the Black-Derman-Toy model of stochastic in¬ 
terest rates [5] . This quantity plays a central role in the simulation of a short 
rate model, as it gives the numeraire in the risk-neutral measure. A good 
understanding of its distributional properties is crucial for the numerical 
application of the model. 

The process can be also related to the statistical mechanics of dis¬ 
ordered systems, see [6] for an overview. The random variable Xn is re¬ 
lated to the grand partition function of a one-dimensional lattice gas of 
non-interacting particles placed in a random external field given by a 
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Brownian motion. This is given by 

n 

( 6 ) = + 

k=l 


with /3 = 1/T the inverse temperature and // the chemical potential. The 
partition function Z [(p] has the same general form as Xn given by the process 
(§. Such systems have been studied in [HdUllII] on the case of a continuous 
one-dimensional gas in the quenched random field approximation. 

We would like to study the large n asymptotics of the growth rate of 
the positive integer moments E[(a:n)'^] with q G Z_|_. More precisely, we will 
consider the n —)• oo limit at hxed 

(7) 13 = • 

Using large deviations theory we will show that the following limit exists 
and defines a Lyapunov exponent for the growth rate of the expectation 


( 8 ) 


Hp,l3-,q)= lim - logE[(x„)''] , g G 

Ti 


The process Q was considered in [26], where the positive integer mo¬ 
ments E[(x„)'^] have been computed exactly (but numerically) for finite n. 
This numerical study showed that these moments have a sharp explosion 
for sufficiently large n or cr, which signals the appearance of heavy tailed 
distributions for the random variable Xn- This phenomenon can be studied 
by mapping the problem to a one-dimensional lattice gas, and the explosion 
is related to a gas-liquid phase transition in this system m- 

The analyticity of Lyapunov exponents has been extensively studied for 
products of random matrices with i.i.d. distributed matrix elements, see 
|9l[29|. The problem considered here is somewhat different, as the Lyapunov 
exponent refers to a deterministic quantity, the expectation of the random 
variable 

The paper is organized as follows. In Section we use large deviations 
theory to prove the existence of the Lyapunov exponent and express it as 
a variational problem. The convergence of the random variable ^ log Xn 
as n —)■ oo and its fluctuations are studied in Section We analyze the 
variational problem for the Lyapunov exponent in Section [^ and present a 
numerical study of its solution in Section Section summarizes an ap¬ 
proximation to the solution of the variational problem which is equivalent 
to the mean held approximation. A rigorous study of the phase transitions 
is presented in Section The slope of the phase transition curve and the 
critical exponents are studied in Sections and [^ respectively. Generaliza¬ 
tions to the Lyapunov exponents of the positive integer moments q >2 and 


the linear stochastic recursion will be studied in Section 10 respectively. 
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2. Lyapunov Exponent and Large Deviations 


Let us consider the discrete time random multiplicative process defined 
by 

(9) Xi+i = UiXi, a* = 1 + 

where Wi = W{ti) is the value of standard Brownian motion at time U and 
ti = ir. The parameters p and a are real positive constants. 

Define the Lyapunov exponent A(/?, /3) as 

(10) X{p,l3):= lim -logE[xn]. 

71^00 Tl 

We would like to show the existence of the Lyapunov exponent and express 
it in terms of a variational formula. Our proof uses the large deviations 
theory from probability. Before we proceed, recall that a sequence (T’n)neN 
of probability measures on a topological space X satisfies the large devia¬ 
tions principle with rate function X : X —>■ M if X is non-negative, lower 
semicontinuous and for any measurable set A, we have 

( 11 ) 

— inf X(x) < liminf — logPri,(^) < limsup — logPn(^) < — inf(X(x). 

n—^oo Tl ,2—^00 U 


Here, A° is the interior of A and A is its closure. We refer to |12j and [M] for 
general background of the theory and the applications of large deviations. 

Theorem 1. The limit X{p, (3) := lim,i^oo ^logE[xn] exists and it can he 
expressed as a variational formula 

(12) X{p,P) = supllogpg{l) + P [ {g{l) - g{x)fdx - [ I{g{x))dx\, 

geg K Jo Jo ) 

where I{x) := xlogx -|- (1 — x) log(l — x) and 

(13) 

^ := {(7 : [0,1] —)■ [0,1] : g{0) = 0, g is absolutely continuous and 0 < < l} 

Proof. By iterating the expression = aiXi, we get 

(14) E[xn] = E[an-ia„_2 • • • oiooxo] 

"n—1 

II (^1 + 


= XqE 

= XqE 

= xo2’"E 
= xo2”E 


Li=0 

n—1 




,,log p+aWi-ljPti 


Li=0 

n-1 


n 

i=0 

n—1 

n 

Li=0 


1 I 1 log p+aWi-^Pt, 

2 2 


g (log p+crWi - 10-2 ti ) Yi 
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where Yi are i.i.d. random variables taking values 1 and 0 with probability 
1/2 and independent of the Brownian motion W{t). Notice that Wi are 
dependent random variables. However, their increments are independent. 
Therefore, it is natural to define their increments as 1/ = TTj+i — H/, i = 
0,1,2,3,... and therefore, we get 


(15) 


E[Xn] = 


~n—l 

n 


^{\og p+aWi-\Yti)Yi 


= xo2^E J 

= a;o2^E 


.1=0 

giogpE 

giogpE 


n—1 

i=0 


n—1 

i=0 


T+E"ro^E;=o(-E-|-MT' 
T+E/r/(Er=7+i TK-E-iaV) 


It is clear that aVj — jcr^r are i.i.d. Gaussian random variables with mean 
— and variance cr^r. Therefore, 


(16) 

E[x„] = xo2”E 


giogpELV E/r/(Er=7+i E)+|-Ve/7(E"=7+i Y? 

= xo2^E [e^"] 

where the exponent is given by 

n—1 / n 


H„ = logp^Ti + ^ I I + 

i=l 

n 

= logp^Ej + 


1=0 \«=l+i 

(5 7 


dx + Tr, 


= n 


^ y=[na:J+l j 


2 = 1 


/o \ n 


2=1 


2=1 


+ o(n). 


The correction is bounded by a deterministic constant and is negligible 
in the large n limit. Recalling that we are interested in the n —>■ oo limit at 
fixed /3 = ^cr^rn^, it is easy to see that the middle term in (16) satisfies 


(17) 




n—2 


n—1 




1=0 \i=l+l 


and it is negligible. 

By large deviations theory in probability, the Mogulskii theorem (see 

Theorem 5.1.2 in [l2]) says that P(^ Z)l=i EG-) satisfies a sample path 
large deviations principle on the space Too[0,1] (i.e. the space of functions 
on [0,1] equipped with supremum norm) with the rate function 

(18) [ I{g'{x))dx, 

Jo 
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where g{0) = 0, g is absolutely continuous, 0 < g' < 1, and the rate function 
is +00 otherwise and I{x) = xlogx + (1 — x) log(l — x) + log 2 is a relative 
entropy function. Informally speaking, it says that 

) 

as n —>■ oo. 

In large deviations theory, the celebrated Varadhan’s lemma says that if 
Pn satisfies a large deviations principle with rate function X(x) on X and 
F : X —>■ M is a bounded and continuous function, then 

(20) lim — log [ e^^^^^dPn{x) = sup{F{x) — I{x)}. 

n^oc n xex 


- ^ Xj ~ g{x 
n 


, 0 < X < 1 ~ e 


—n I(g'{x))dx-\-o(n) 


It is easy to check that for any g G i^oo[0,1] H Q, 

(21) g^logp-g{l) +j3 ! {g{l) - g{x)fdx 

Jo 

is a bounded and continuous map. 

Hence, by Varadhan’s lemma, we conclude that the limit lim,, 
exists and is given by the variational problem (12). 


^logE[xr, 

□ 


We present next a few immediate implications of this result for the asymp¬ 
totics of the Lyapunov exponent in the limiting cases /3 —)■ 0, oo and p ^ oo. 


Proposition 2. (i) The /? —)• 0 limit for the Lyapunov exponent is 

(22) A(p,0) =log(p + l) 

(a) The Lyapunov exponent is bounded from above and below as 

(23) + log{l +p) > X{p,P) >^/3+ logp. 

(Hi) These bounds give the asymptotic behavior in the large p and large j3 
limits 


(24) 


lim 

P^oo 


Kp,P) 

/3 


1 

3’ 


and 

(25) 


lim 

p^oo 


x{p,P) 


3 


log/9 


= 0 . 


Proof, i) Taking into account that x —)> I{x) is a convex function, Jensen’s 
inequality implies the upper bound 

(26) A(p,0) < sup |logp 5 (l) - / g{x)dx 

= sup{logpg{l) - I{g{l))} 

9 

= sup {log px — I(x)} . 

0<x<l 
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On the other hand, choosing g[x) = g{'\-)x, it is clear that we have the lower 
bound 


(27) 


A(/9, 0)> sup {x logp —/(x)} . 

0<a:<l 


Hence, when /3 = 0, we must have 


(28) 


A(p,0)= sup {xlogp-/(x)}. 

0<a:<l 


At optimality, p = and therefore 

(29) A(/9,0) = log(p +1). 

ii) A lower bound on the Lyapunov exponent A(/?, /3) can be obtained by 
taking g{x) = fl'(l)x in (12), which gives 


(30) 


^{p,P)> sup <j logpx + ^x^ —/(x) 
0<a;<l 


An explicit result for this lower bound will be given below in Section see 
Proposition 12 For now we derive a simpler but weaker lower bound by 
taking g{l) = 1, 


(31) 


A(p,/3) > logp + /3 




- x)‘^dx - 1(1) = ^ + logp , 


which gives the lower bound in (23). 

On the other hand, by the Mean Value Theorem, |5(1) — g{x)\ < |1 — x| 
for any ^ < g' <1. Also, using the Jensen inequality for the last term as in 
(i), we get the upper bound 

(32) 


A(p,/3)= sup 

3 ( 0 )= 0 , 0 < 3'<1 

< sup 

3 ( 0 )= 0 , 0 < 3'<1 

/3 


logpg{l) + 13 {g{l) - g{x)fdx - I{g{x))dx'^ 

logpfif(l) (l-xfdx- j /(ff'(x))dx| 


= 3 +log(p+ 1). 


This proves the upper bound in (23). 


(33) 


Dividing by /3 in (23) and taking the /3 —>■ oo limit we conclude that 

A(p,/3) ^ 1 

3 ■ 


lim 

p^oo /3 


This proves the relation (24). 

Subtracting J(3 + logp in the inequalities (23) gives the asymptotics (25) 


(34) 


lim 

p^oo 


Kp,P) - ^ - logp 


= 0 , 


□ 
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Remark 3. The result (i) agrees with the intuitive expectation: the limit 
/3 —)• 0 corresponds to taking cj —>■ 0 in the random multiplicative process 
which becomes a deterministic recursion in this limit. This is solved as 
Xn = (1 + p)”, and the Lyapunov exponent is given immediately by A(p, 0) = 
log(l + p). 


3. Almost Sure Limit and Fluctuations 

We prove in this section a strong Law of Large Numbers and a fluctuations 
result for -\ogXn- We start by considering first the simpler case of the 
random multiplicative model Xj+i = aiXi and then we will derive the LLN 
under the more general assumption of the presence of i.i.d. additive noise 
bi. 

Proposition 4. Almost surely, 

(35) ^ ^ 

lim -loga:„= lim -[logan_l+logo„_ 2 ^-hlogao+logxo] = log(l+/9). 

n—^oo 71 n^oo 77 

Proof. Let us recall that 

(36) Xji — On,—iRn —2 ■ ■ ■ ®I®0^0) 
where 

(37) Ui = l + 

where L = ir and /3 = ^a'^rn'^ is a universal constant. Therefore, it is easy 
to check that ha'^tn = - —)■ 0 as n —)• oo. 

Moreover, for any e > 0, by Chebyshev’s inequality, for any 0 > 0, 

(38) 

IP(kW„| > e) = 2¥{aWn > e) < = 2e®'-e-®L 

By choosing 6 = y/n, we get 

(39) lP(|fTW„| > e) < 2e^e"^S 

and hence X^^i > e) < oo for any e > 0. By Borel-Cantelli lemma, 

<TkFn —^ 0 almost surely. Therefore, 0^— )-l + /oasn—)-oo almost surely. □ 

The main LLN result follows. 


Theorem 5. Assume that E[6o] < oo. Then, 

(40) lim - logXn = log(l + p), 

n^oo Tl 

almost surely as n ^ oo. 

Proof. Since > xq 0^=0^ ^y Proposition]^ 

lim inf — logXn > log(l + p), 

n^oo Tl 


( 41 ) 


GROWTH RATE OF A LINEAR STOCHASTIC RECURSION 


9 


almost surely as n —>■ oo. On the other hand, 


(42) 


Therefore, 


71—1 

Xn ^ + feo + &1 + ■ ■ ■ + bji—l) Cli- 

1=0 


n 


n 


n 


j. j- j- Xq 

(43) - log Xn< - log n + - log (-h 


bo + bi + ■ ■ ■ + bn-i\ , 1 


n 


n 


n—1 


+ - log ^ ( 
n 


1=0 


Since E[6o] < oo, by strong law of large numbers, ^o+bi+-+b„ i E[bo] 
almost surely as n —>■ oo. By Proposition]^ we conclude that 

(44) limsup — logx„ < log(l + p), 

n^oo ^ 


almost surely as n —>■ oo. □ 

Remark 6. First, we notice that the almost sure limit lim„_,.oo ^logXn = 
log(l + p) is analytic everywhere in the phase plane {p,(3) while the Lya¬ 
punov exponent exhibits phase transitions. The almost sure limit has very 
different behavior than the Lyapunov exponent lim„_,.oo ^ logE[x„]. The dif¬ 
ference arises from the fact that the almost sure limit is determined by the 
typical events, i.e. the law of large numbers, while the Lyapunov exponent 
is determined by the rare events, i.e. the large deviations. 


Next we present a fluctuation result. 
Proposition 7. ITTien bi = 0, 

^OgXn - n log(l + p) ^ 

in distribution as n ^ oo. 


n 


iV 0, 


2/3 

3 {l + P? 


Proof. When = 0, = a^o nr=o^ ^^ogXn —)• log(l + p) a.s. as 

n —)• oo. It is straightforward to compute that 

(46) 


logXn - nlog(l + p) logxo , 1 


n—1 


n 


n 




p{e 




1=0 


l + P 


logxo 1 ^ p 

+ ^ > ——crWi + en, 
Jn l + P 


n 


where 


n—1 


(47) 


1=0 L 


log 1 + 


P(e' 


i=0 


crWi-^Pti _ ' 


l + P 


l+P 


-aWi 
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For any x > —1, log(l + x) < x. Thus, 


— r~ 1 I 1 I 

y/n^ 1 + p 1 + p 


- n —1 

V ' r •_n 


Note that e„ > 0 and 


- IL— 1 

V ' ' r •_n 


- 1 


- n —1 

i_ ^y[ 

/nl + p^L 


/3i 

— 1 


1 p C" — 1 


= ^Ti-^-^ ^0’ 

\/n 1 + p [g^J _ 1 

as n —)• oo. Thus —)■ 0 in probability. 

For any x G M, let F{x) := log ^1 + — y,x. Then, F(0) = 0, 

^ 1. S(t - 1) - rT7' 

_ Pe^ 

('51) F”(x) = __ 

Thus F"{x) > 0 for any x G M and hence F'{x) is increasing. Note that 
F'(0) = 0, thus F'{x) < 0 for any re < 0 and F'{x) > 0 for any x > 0. Since 
F(0) = 0, we conclude that F{x) > 0 for any x G M. Therefore, 

1 r 1 1—1 R' 

(52) (yWi - -a^ti - aWi = — y~] ^ 0, 

Jn 2 Fn ^ 

'^1 = 0'- J V j^Q 

as n —)■ oo. Hence, we conclude that e„ —)■ 0 in probability as n —)■ oo. Also, 
we have —)■ 0 as n —)• oo. Finally, notice that ^ J2?=o is a 

normal random variable with mean zero and variance 


- n—1 

1 p 


- n—1 

1 p 


Var -^'y -crlTi = Var —= - ain — i)iWi — Wi- 

j^y^i + p ^yi + p^ ^ 


2/3 2 

n ^ (1 + p)2 n2 ' 
2/3 

3 {l + P?' 


as n —)■ CO. 
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Proposition 8. Assume bi are i.i.d. non-negative random variables with 
finite mean. 


(53) 


\ogXn - nlog(l + p) 


n 


NIO, 


2/3 

3 (1 + P)2 


in distribution as n —)■ oo. 
Proof. Note that 


n—1 


n—1 


n—1 


(54) Xn = Xo Oj + 5o + &1 H - h 6„_20n-l + bn-1. 

1=0 


2=1 


2=2 


Since a* > 1 and 6* > 0, we have Xn > xq OILo^ 


n—1 


(55) 


Xn < (xo + 5o + ^1 + • • • + bn-l) 


i=0 


By strong law of large numbers, ^(xq + 5o + 6i + • • • + 6n-i) —^ IE[5o] a.s. as 
n —)• oo. Thus, log(xo + 5o + 6i + • • • + bn-i) —>• 0 a.s. as n —)• oo. The 
result then follows from Proposition!^ 

4. The Variational Problem 


□ 


We give in this Section the solution of the variational problem in Theo¬ 
rem!^ for the Lyapunov exponent X{p,fi). The variational problem in (12) 
can be formulated equivalently in terms of the function /(x) = g'{x) and 
the functional A[/] defined as 

(56) A(p,/3) = supj(,^)A[/] 

A[/]=logpy dxf{x) + /3j dx(^J dyf{y)^ -j dxl{f{x)) 

defined in terms of a function / : [0,1] —>■ [0,1] subject to the constraints 

(57) 0 < fix) < 1. 


The functional A[/] defined in (56) can be written in a more symmetrical 
form as 

(58) 

A[/] = logp/ dxfix) + fi[ dx( 

Jo Jo 


- / dxlifix)) 
lo 


= Jo dxi^logpfix) + fi dy d^;A:(z, y)/(z)/(y) -/(/(x))| , 

where the kernel K[z,y) is K{z,y) = min( 2 ;,y). 

Taking the functional derivative of (58) with respect to / we get the 
Euler-Lagrange equation 

(59) =logp + 2/3 [ dzK{y, z)f (z)-log 


6f 


1 - fiv) 


= 0 . 
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This integral equation can be transformed into a differential equation by 
writing out the integral over the kernel in an explicit form 


(60) log p +2/3 [ zf{z)dz + 2j3y I 
Jo Jy 

Take one derivative with respect to y 

fiv) 


f{z)dz - log 


fjy) 

1 - f{y) 


= 0 . 


(61) 2/3 


f dzf{z 
Jv 


dy 1 - f{y) 


1 


/(2/)(i-/(y)) 


fiy) 


Taking another derivative with respect to y we obtain finally a second 
order differential equation for the optimizer function f{y) 

dy‘^ 


(62) 


2/3f{y) = -^log 


f{y) 


1 -/(y)' 

This must be solved with the boundary conditions 


(63) 


/( 0 ) = 


P 


l + p 


/'(i) = o. 


The first boundary condition (at y = 0) is obtained by taking y = 0 in the 
Euler-Lagrange equation (59). The integral vanishes and we get an equation 
for /(O) which is solved with the result shown above. The second boundary 
condition (at y = 1) is obtained by taking y = 1 in equation (61). 


Remark 9. The functional A[f] given in ( |5^ has a simple physical inter¬ 
pretation: this is related to the Landau potential (grand potential) Ll of a 
gas with density f{y) enclosed in a box (0,1). The particles of the gas in¬ 
teract by an attractive 2-body interaction with potential —2K{z, y). The gas 
is in contact with a thermostat of temperature T = 1//3 and a reservoir of 
particles with chemical potential p, = Tlogp. 

This can be seen by writing the extremal value of the functional (58) as 

(64) 


X{p,/3) = = -^{U -TS - pN) 


with N the total particle number, S the entropy and U the energy 
N = [ dxf{x) 


(65) 

( 66 ) 
(67) 


5 = - 


[ dxl{f{x)) 
Jo 


U = - dydzK{y,z)f{y)f{z) 
Jo 


and f{x) is given by the solution of the Euler-Lagrange (59). The equation 
for the density f{x) is an analog of the isothermal Lane-Emden equation 
discussed in the canonical ensemble in m- 
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4.1. Solution of the Euler-Lagrange equation. The equation (62) can 
be alternatively expressed in terms of the function 


( 68 ) 


h{y) = log 


fjy) 

1 -/( 2 /)' 


The function h{y) satisfies 


(69) 


h"{y) = -2(3 


oKy) 


1 + 


with boundary conditions 

(70) /i(0) = log/9, 


/i'(l) = 0. 


The solution of this equation is presented in the Appendix Further¬ 
more, it can be shown that the functional A[h] depends only on h{l), and is 
given explicitly by the following Proposition. 


Proposition 10. If f{x) is a solution of the Euler-Lagrange equation (59), 
then A[/] depends only on /(I) or equivalently h{l). This is given by the 
relation 


(71) 


.h(i) 


A[/] = log(l -b e^l^l) - dxy 


1 -b e^W 


log 


1 -b 


Proof. The proof is given in the Appendix [A} 

In conclusion, the Lyapunov exponent is given by 

(72) A(p, (3) = sup;j(i)A[/i(l)]. 

The condition = 0 gives an equation for /i(l) 

(73) F{h{l);p) = 2^ 
where T(o; p) is given by 

dx 


□ 


(74) 


F(a;p) = 


Pogp ./log 


l+e° 

l+e^ 


The variational problem is now solved in 2 steps. 


1. For given {p,(3), find /i(l) by solving the equation (73). This could 
have one or three solutions, depending on the values of p, (3. 

2. For each solution for h{\) obtained in the previous step, compute the 
functional A[/] using equation ©• Take the supremum over these values. 
This gives the Lyapunov exponent X{p,(3). 

From this solution one can see that the Lyapunov exponent X{p,/3) is a 
continuous function of its arguments, as it is the supremum of a family of 
continuous functions, depending in a continuous way on the parameters p, (3. 
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Figure 1. The function F(a; p) vs a for several values of p 
as shown. 


5. Numerical study of the solution 

We study in this section the numerical solution of the variational problem 
described in the previous section, and present the results for the Lyapunov 
exponent. The first step of the solution consists in finding h[l) from the 
solution of the equation (73). We show in Figure plots of the function 
F{a]p) for several values oi p = 0.01,0.05,0.123,0.2,0.5. The intersection 
of the curve F(a; p) with the horizontal line 2\/]3 determines a = h{l) for 
given /3. 

We note from Figure that the shape of F(a; p) is qualitatively different 
for p above or below a certain critical value pc — 0.12. For p > pc the 
function F{a; p) is strictly increasing, while for p < pc it has a minimum 
and a maximum. At p = pc the function F(a-,pc) has an inflection point. 


It p > Pc the equation (73) has a unique solution for h{l), while for p < Pc 
this equation has one or three solutions, depending on /?. 

The Lyapunov exponent X{p,l3) is given by the supremum of the func¬ 
tional A[/i(l)] given in 0) over the solutions of the equation F(a; p) = 2^/p. 
The functional A[/i(l)] takes a simpler form if we choose as independent vari¬ 
able the integral Iq instead of h(l). These two variables are related by 


(75) d= 1^' dxfix) = il±^/'(0) = 4^'(0) = 4^f/log ^ ^ 


2Pp 


2/3 




l + p 


The variable d = Iq takes values in d E (0,1). 
We have 

(76) A{d) = fid^ + log(l + p) - 2/3(1 -h p)d^ f 


y^dy 


Jo l + ■ 

We will use this expression for the numerical evaluation of the Lyapunov 
exponent A(p,/3) = suprfg(o,i)A(d). 















GROWTH RATE OF A LINEAR STOCHASTIC RECURSION 


15 


We present in Figure[^plots of the Lyapunov exponent X{p, (3) = suprfA((i) 
These plots show X{p,l3) vs 13 at fixed p = 0.025,0.05,0.125,0.2. The Lya¬ 
punov exponent has a discontinuous derivative at /3cr(p) for p < pc- The 
phase transition curve (3cr{p) is shown in Figure]^ as the black solid curve. 
It ends at the critical point C with coordinates 

(77) Pc = 0.12328, /3c = 5.12013, 4 = 0.372. 

Next we study the dependence of the parameter d on p and p. Start by 
keeping p fixed and consider the dependence of d on /3. We have limp_^oo d = 
1, as this value maximizes the second term in the functional A[/]. and 
limp_^o d = as this value maximizes the sum of the first and last terms 
in A[/]. For intermediate values of (3, provided that p < pc, d has a jump 
discontinuity at a certain value /3cr(p) and jumps from a value 4 to di. If 
p > Pc d IS a continuous function of (3. For p = pc, d is continuous but 
its derivative with respect to f3 becomes infinite at the (3 = f3c point. This 
behavior is shown in Fig. which shows plots of d = d{p, (3) vs 1/(3 for 
several values of p. The dashed curves show also di,d 2 vs 1/(3 along the 
phase transition curve. 

A similar picture holds for the dependence of d on p at fixed (3. 11 (3 < (3c 
d is a continuous function of p. 11 (3 > (3c it has a discontinuity at some 
value Pcr{(3), and il (3 = (3c its derivative at p = pc is infinite. 

In Appendix [B] we derive an analytical approximation for the functional 
A(d) in the limit (3d? S> 1, which is used to obtain the properties of the 
phase transition curve and of (di, d 2 ) along the phase transition curve in the 
/3 —7- oo limit. This is summarized by the following result. 


Proposition 11. The solutions of the variational problem for A(d) given 
in Eq. (76) approach the following limits for very large (3 (p <C IJ 


(78) 


lim di = 0 , lim d 2 = - . 
^—^OO /3—^oo 4 


The phase transition curve is given in the same limit by 
(79) /3cr(p) = log {y^) d 0 • 

See Appendix for the proof. 

We comment on the relation of these results to the statistical mechanical 
interpretation of the variational problem. As mentioned in the Remark 
the Lyapunov exponent A(p, (3) is related to the equilibrium value of the 
thermodynamical potential ll{T,p) of a gas of particles interacting by the 
two-body potential V{x,y) = —2min(x,y). The gas is enclosed in a box 
X G (0,1) and is maintained at fixed temperature T = 1/(3 and chemical 
potential p = Tlogp, which corresponds to the grand canonical ensemble. 
The solution of the variational problem discussed here demonstrates the 
presence of a phase transition in this system. The equilibrium density of 
the gas is given by f{x). Both the distribution density f{x) and its average 
value d are discontinuous across the phase transition curve /3cr(p)- 
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Figure 2. The Lyapunov exponent A(p, /3) vs (3 at fixed p = 

0.025 (black), p = 0.05 (red), p = 0.125 (blue) and p = 0.2 
(orange). The partial derivative dpX{p,l3) is discontinuous 
at one point /3cr(/o) for p < p^. The dashed curves show the 
upper and lower bounds on X{p, P) for p = 0.025 given in 
( [^ . The upper bound is saturated at /3 = 0 as shown in 
Proposition]^ (i). 

This system is similar to the lattice gas considered in m- This pa¬ 
per considered a lattice gas with n sites with interaction energy V{x,y) = 
— ^K{x,y) (after appropriate rescaling of the lattice volume to 1). The 
thermodynamical properties of this system have been computed in the ther¬ 
modynamical limit n —7- oo in the isobaric-isothermal ensemble. The results 
obtained in [27] for the equation of state and the phase transition curve 
are in agreement with those obtained here directly in the grand canonical 
ensemble. 


6. Mean-Field Approximation 


A simple approximation to the solution of the variational problem is ob¬ 
tained by assuming that the function f{x) = a is a constant. This corre¬ 
sponds to finding the supremum over a G (0,1) of the function 


(80) 


X{p, /3) = sup„g(o,i) 


|alog/9-F ^/3a 


2 



X{p, (3) gives a lower bound for the exact rate function in (56) 


(81) 


X{p,/3)>X{p,/3). 


This approximation leads to the well-known Curie-Weiss mean field the¬ 
ory |17l l33l [T5| . This formula also appears as the limiting free energy of an 
edge and 2-star model in the exponential random graph models whose prop¬ 
erties have been studied rigorously in |8l |28l |3| . For the problem considered 
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Figure 3. Plots of d = d{p,l3) vs 1//3 at fixed p = 0.025 
(red), p = Pc (black) and p = 0.2 (blue). The dashed blue 
curves show the values of the optimizer variable di,d 2 vs 1//3 
along the phase transition curve. They become equal at the 
critical point C. 


here the lower bound X{p,(3) gives a van der Waals approximation for the 
Lyapunov exponent following from the equation of state of the equivalent 
lattice gas with temperature l/f3 and fugacity p [27] . 

We summarize below without proof the main results of the mean field 
approximation. 


Proposition 12. i) The function X{p,l3) is given by 
(82) A(p,/3) = -^/3o2-log(l-a*) 

where a* = a^{p,l3) is given by 


(83) 


a*{p,l3) = 


a2{p,l3), logp>-|/3 
ai{p,fd), logp<-|/3 

where ai ^2 ®Te the smallest and largest solutions of the equation 


(84) 


logp 


2 

3 


/3a + log 


a 

1 — a 


if this equation has multiple solutions, or the unique solution of this equation 
if it has only one solution. 

a) The function X{p,/3) has discontinuous partial derivatives with respect 
to its arguments at points on the phase transition curve 

(85) logp+^/3 = 0, 

with /3 > /3c = 6. This curve ends at the critical point {pddc) = (e~^,6). 
Across this curve, the solution a* jumps between a*i ^2 = 5(1 T ^{P)) where 
A(/3) is the positive non-zero solution of the nonlinear equation A = tanh (g/3A). 
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Figure 4. The phase transition curve (3cr{p) in coordinates 
(yO, 1//3), obtained from the numerical solution of the model 
(black curve). It ends at the critical point C. Blue dashed 
curve: the phase transition curve in the mean-field approxi¬ 
mation, which is given by Eq. (85). 


Remark 13. The function X{p,l3) is related as X{p, ft) = ftpvdw to the 
pressure of a van der Waals lattice gas with uniform long-range interaction 
3n m- This is identical to the equation of state of a lattice gas with 
Kac interaction [2T]. 

The partial derivatives of X{p, ft) with respect to its arguments are dis¬ 
continuous across the phase transition curve. The discontinuity approaches 
zero near the critical point. The law of the discontinuity near the critical 
point is usually parameterized in terms of a critical exponent. Consider any 
quantity M which is discontinuous across the phase transition curve. If the 
jump discontinuity approaches zero as ft ^ ftc as 

(86) AM ~ 7|/5 - ,5^1" , 


then a is called the critical exponent of the quantity M. 


The jump discontinuity of the solution a of the variational problem (80) 


for G(a; p, ft) is given by the following well-known result of mean-held theory 

[I3|33l[l5]. 

Proposition 14. Along the phase transition curve, very close to the crit¬ 
ical point ftc, the difference of the two solutions ai < 02 of the variational 
problem (80) approaches zero as ft ^ ftc as 


(87) 


02(/3) - ai(/3) = A(/3) ~ V3 - 1 


1 

2 
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( 88 ) 


-a, 


Consider the jump of the partial derivatives of A(p, f3) with respect to p 
and /3 separately. Off the phase transition curve we have 

(dx^\ ^1 

V dp p' 

which means that this derivative has a jump discontinuity across the phase 
transition curve 

(89) =h«2(/S)-ai(/3)) = -A(/S)~A!(^_iy''h 

\ dp J p P P P \Pc J 

In a similar way, we have off the phase transition curve 

( d\{P,li) \ _ 1 2 

V d^ ^ 3“ ’ 

which gives the following result for the jump of this partial derivative upon 
crossing the phase transition curve 


(90) 


(91) A 


1 


7. Phase Transitions 


In this section, we study rigorously the phase transitions for the Ly- 
papunov exponent \{p,j3). Before we proceed, let us introduce the formal 
definition of phase transitions. We will adopt the following definition of 
phase and phase transition |15l [28] . 

Definition 15. A phase is a connected region of the parameter space {(p, /3)}, 
maximal for the condition that the Lyapunov exponent X{p, ft) is analytic. 
There is a jth-order phase transition at a boundary point of a phase if at 
least one jth-order partial derivative of X{p, ft) is discontinuous there, while 
all lower order derivatives are continuous. 


7.1. First-Order Phase Transition. Recall that the Lyapunov exponent 
is given according to equation ( [^ by 

(92) A(p,/3) = log(l+ e“) - ^ / dxJlog 

VPJiogp V l + e^ 

where a denotes the optimal value of h{l) on which the supremum of the 
functional A[h(l)] is realized. 

Hence, if o is unique, we can compute that 


(93) 


dp 


1 + e“ 


^17“ dx 

Jlogp ^log^ 


da ^ I 1 l + e“ 

^ V 1 + ei°gP 



/l + e“A 

Vi+/^y‘ 
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Similarly, we can compute that 

I = ^ + '“S(1 +«“)) ^ 

Therefore, if a is unique, the Lyapunov exponent is analytic and there is no 
phase transition. On the other hand, if there exist two distinct oi and 02 that 
give the same value of X{p,j3), then when we change the parameters (p,/3) 
continuously, the value of a changes and this causes a jump discontinuity of 
the first-order derivative, which leads to the first-order phase transition. To 
summarize, if T(a; p) = 2y/]3 has more than one solution that gives the same 
value of Lyapunov exponent, then there is a first-order phase transition. 
Otherwise the Lyapunov exponent is analytic in its arguments. 

Proposition 16. There exists p^ G (0, 00 ) so that for any 0 < p < p^, there 
exists a first-order phase transition. 

Proof. Let us first analyze 


(95) 


F{a;p) = [ —r 
•^logp J] 


l + e“ 


(96) F{a;p) = 

J 

Therefore, it suffices to study 

(97) 


dx 


P ^log 


1 = log , 

we 

l-he“ 

1 


1 -|- e“ — 


dy. 


, . a 1 

G{a) = - a>l + p, 

Jo a-ev ^ 


which is related to T(a; p) as F{a; p) = G(1 -|- e“). 
It is straightforward to compute the derivative 


(98) 


G'{a) = 


l + p 1 


e2/ 1 


Jo 


{a - evy ^ 


dy, 


from which it follows that one has G'(l -|- p) = 00 and G'(oo) = 0. 
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Let X = Then, for any fixed x > e, using integration by parts, 
(99) 

rlogx 


G\a) = 


xp^/\og X Jo {{l + p)x-eyy^ 


dy 


1 


rlog X 


1 


xpy/logX Ji ((1 + p)x - eyf 


1 


flog X 2 


:d 


1 


1 


-d 


1 


xp^/\og X Ji y/y \{l + p)x-ey^ 

1 I r^ogx 

xpy/k)^ xpyjlog X {I + p)x — 6 Ji {1 + p)x — ey \^/y 
1 1 1 1 
(1 + p)x — e 2 Ji (1 + p)x — ey ^ 

Observe that the first term in this expression is always positive 

lim ^-r-=-, 

p-s>o+ (1 + p)x — e X — e 

while the second term diverges as p —)■ 0+ 

1 1 1 . 1 r 1 1 


( 100 ) 


00 . 


(1 + p)x — ey 2/3/2 2^(1 + p)x — z (log zY^z 


> 


1 


1 


2(logx)3/2x Jg {1 + p)x — Z 


dz 

dz 


1 


2(logx)3/2x 

■ + 00 , 


log 


(1 + p)x - e 
px 


as p —)■ 0+. Hence, we conclude that for any fixed x = > e, the derivative 

G'(a) becomes negative for sufficiently small p > 0 


(102) 3p^ > 0 , G'{a) < 0 for all 0 < p < p^ . 


Therefore, by continuity, for any p sufficiently small, there exists an interval 
on which F\a; p) is negative. 

Moreover, for any p > 0, the function F{a; p) grows without limit as 
a —7- oo. This follows from the lower bound 


(103) 


F{a;p) = 


> 



l + e“ 1 

-— au 

1 + e“ — 




2 



—)• oo. 


as a —)■ oo. Hence, we conclude that F{a;p) is increasing on an interval 
(log p, log p + M) and F{a; p) is decreasing on (log p + M, log p + M + iL) for 



22 


DAN PIRJOL AND LINGJIONG ZHU 


some M,K > 0 and F{a]p) —>■ oo as a —)• oo. Hence, there is a first-order 
phase transition for any sufficiently small p. □ 

Proposition 17. There exists p^ G (0, oo), so that for any p > p^, the Lya¬ 
punov exponent X{p, /3) is analytic and hence there are no phase transitions. 


Proof. Denoting x = > 1 as above, we have 


(104) 


G '{ a ) = 


1 


flog X 


1 


> 


xpy/log X Jo {{1 + p)x - ey)"^ ^ 

1 1 ey , 

-^dy 


dy 


xpy/log X p^x"^ Jo y/y 
1 


where we denoted 
(105) 


- , 1 - -H{y/logx)] 

pXy/logX \ P J 

H{x) = xe-^" / ^dy = 2x6“^' 

Jo y/y Jo 


dte^ 


The function H{x) has the following properties: i) -H(O) = 0; ii) H[x) is 
positive for x > 0, and has a maximum at xq = 1.502 where it takes the 
value H{xo) = 1.28475; hi) lim 2 ;^oo H{x) = 1. The property hi) follows by 
an application of the L’Hospital’s rule 


(106) 


Z ^2 Z 

iim —yt / ~ - r ~ ^ • 


These properties imply that the function H (x) is bounded from above as 
H{x) < H{xo), and thus for p > H{xo) the expression on the right-hand side 
of ( 104| ) is positive for any x > 1. This shows that for sufficiently large p, 
there can be only one optimal /i(l) and thus the Lyapunov exponent X{p, /3) 
is analytic. □ 


Remark 18. Our analysis showed rigorously that there is no phase tran¬ 
sition for sufficiently large p and there is a first-order phase transition for 
sufficiently small p but we cannot show analytically what is in between. Nu¬ 
merical studies in Section^ gave strong evidence that p^ = p^. 


7.2. Second-Order Phase Transition. It has been shown 
that if the equation T(a; p) = 2y^ has a unique solution for a. 


m 


Eq. ([9^ 
we have 


(107) 


dX 11 f /I -ke“\ 
dp p\l +P )' 


where a is the solution of the equation F(a; p) = 2^/]3. 
Let us define 


d 
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From the proof that there is no first-order phase transition for large p and 
there is first-order phase transition for small p, it is easy to see that 0 < 
Pc < oo. Moreover, for any p > pc, ^F{a‘, p) > 0 for any a. By continuity, 
^F{a]pc) > 0 for any a. It is also easy to see that there exists some Oc 
so that ^F{ac', Pc) = 0 and define /3c as 2y/~^ = F(oc; Pc)- (Note that our 
analysis does not show that /3c is unique although numerical results suggest 
so.) 


Proposition 19. There is a second-order phase transition at (pdic)- At 
this point all second order partial derivatives of X{p, /3) are infinite. 


Proof. First, since ■^F{a; pc) > 0 for any a, by (107), there is no first-order 
phase transition. Next, we can compute that 
(109) 




1 




--log 

P 


1 -be“ 

1 p J 2(1 + p) ' 2 1 -\- 0°^ dp 


1 

+ a: 


da 


where F{a', p) = 2y(5. Off the phase transition curve, we differentiate the 
equation F(a; p) = 2y/fi w.r.t. p at fixed /3. Using (93) we have 


( 110 ) 


d da 1 1 

T^P^WP)-^ = - 1=- 

da dp p 


l+e° 

1+P 


Since ^F{a] p) = 0, we have % = oo. More¬ 

over, since ^F{\ogp\p) = oo, it is clear that at {pcfic), log(^y^) does not 
vanish. Together, we proved that 


( 111 ) 


, d‘^X 
hm = oo. 

(p,/3)^(pcA) dp^ 


Consider next the partial derivative dpX. This is given by 


Since X{p, f3) is continuous in its arguments, there is a first-order phase 
transition if a has a jump discontinuity, i.e. switching from one solution 
to the other of the equation F{a; p) = 2y/fi. It is clear that there is no 
first-order phase transition at {pcfic)- Since 


(113) 


d^X 

w 


1 


1 


~ + loS(l + ^°')) + Wo “Ta + 


2/3- 


dX 


da 


2fi \ dfi 1 -h e“ dfi 
da 


4^2 + ® +2/31 + 6“ 9/3’ 

and p ^ — )• oo as (p, /3) —)• {pc, /3c), there is a second-order phase 


transition at (pcfic)- 
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Finally we consider the cross second derivative. This can be computed in 
two ways, taking the derivatives in either order. We get 


(114) 


1 


dpdfi 


1 1 


1 / 1 + e“ 

2/33/2pV 1 + P ^ ^P2 


1 


da 


log 1 


1 


1 f 1 + e“ 1 
^og— -+ 


da 


2/33/2 pY ® p ' 2 fjl + e°-dp 
Comparing them we get the following relation between the partial derivatives 
of a, the unique solution of the variational problem, 

da 1 f 1 + e“ aa 
(115) l^ = ^P\l^og- 


d/3 y/]5^ V 1 + p dp 

This relation holds only off the phase transition curve, or at the critical 
point. Elsewhere on the phase transition curve, a is discontinuous and its 
partial derivatives do not exist. This is an analog of the Maxwell relations, 
which are well-known in thermodynamics [33]. 

We have seen above that at the critical point (p, /?) —)■ (pc, /3c) both partial 
derivatives {da/dp) and {da/d/3) become infinite. This implies that the limit 
of ([Il4|) as (p, /3) {pc, 13, 


is infinite also. 


□ 


The divergence of the partial derivative {da/dl3)p=p^ eA j3 ^ Pc is seen in 
graphical form in Figure]^ The black solid curve shows d{pc, P) as function 
of 1/p. Recalling that d is related to a as (75), one obtains 

,-0d? 


(116) 


dd__l 1 


1 - 



This becomes infinite as we approach the critical point P 
curve of fixed p = pc, as seen in Figure]^ 


Pc along the 


8. The Slope of the Phase Transition Curve 

We prove in this section a relation for the slope of the phase transition 
curve Pct{p)- This is given by the following result. 

Theorem 20. (Clausius-Clapeyron relation) The slope of the phase tran¬ 
sition curve P{p) is related to the ratio of the jump discontinuities of the 
first partial derivatives of A(p, P) with respect to its arguments. This ratio 
is given by 


(117) 


dPcT 

dp 


A 


dXip,f})\ 
dp ) 

d\(p,P) \ 

dp ) 


p{di + d2) 


where the jump discontinuities of the derivatives across the phase transition 
curve are defined as 


(118) 


A 


/(9A(p, P)\ 

fdX{p,P)\^ 

/dX{p,P)\ 

V dp ) 

V dp 

\ dp ) 
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and analogous for A( ) • di < d 2 are the solutions of the variational 


dh 

problem for A{d) on the phase transition curve. Recall that d is related to 
h{l) as shown in equation (75). The two solutions di ^2 become equal at the 
critical point \\m.p^p^{d 2 — dij = 0. 


Proof. The proof of the relation (117) uses the continuity of the Lyapunov 
exponent X{p, (5) across the phase transition line. Equating the change in 
A(p, (3) as we move along the transition curve, on one side and on the other 
side of the curve respectively, we get 

(119) hA(p,/3) = (^^^)d/3|phasel 




5/3 


This gives immediately the first equality in equat ion (|117 ). 

In order to prove also the second equality in (117), we use the explicit 
expressions for the partial derivatives obtained in (93) and (94). These 
relations simplify when expressed in terms of the d variable, related to /i(l) 
as in ( [T^ . We obtain, off the phase transition curve, 

d, 

P 
1 


(120) I 

0 

/'dX\ 

(121) I 

iie) 

The jump discontinuities 

(122) 


(123) 

A( 


/3d^ + log(l + p) - X{p,f3) 


dX{p,(3) 

dp 

dX{p, (3) 
d(3 


) = -{d2 - di) 
) P 

) = \{dl-dl) 


Using these expressions into (117) one finds the explicit result for the slope 
of the phase transition curve given in the second equality of ( |117 ). □ 

Remark 21. We note that the results of the Proposition\ll\ are in agreement 
with the relation (111) for the slope of the phase transition curve. 


Remark 22. A relation of the form (111) holds also in the mean-field ap¬ 
proximation. For this case we have to replace d with a, which is the opti¬ 
mizer of the variational problem for G(a; p,/3). The jump discontinuities of 
the first derivatives ofX{p,/3) have been computed in (89) and (91), respec¬ 
tively, which gives the slope of the phase transition curve 


(124) 


d^ 

dp 


7 ^(/ 3 ) 

^A(/3) 


3 

P 


This agrees with the known result for the phase transition curve (85) in the 
mean-field approximation. 
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A relation of the form (117) has been proved in [3] for the slope of the 
phase transition curve in the p—star ERGM, see Theorem 3 in [3j. 


9. Critical Exponent 

We have already seen that at (/Oc, /3c)) Pc) = 0 and F is increasing 

everywhere. Therefore, ^^F{ac', Pc) = 0. (Otherwise, Oc is a local minimum 
(resp. local maximum) if ■^F{ac] Pc) > 0 (resp. ^F{ac',Pc) < 0), which 
contradicts F being increasing everywhere.) Moreover, since ^F{a', pc) > 0 
for any a in a neighborhood of Uc except at Oc and ^F{ac‘, Pc) = 0, we 
conclude that Oc is a local minimum of the function ^F(a-, pc), which implies 
that ■^F{ac\ Pc) > 0. 

Along the phase transition curve, there exist ai < Oc < 02 such that 
F(ai; p) = F{a 2 ; p)- If there exists the relation 

(125) 02 - ai ~ 7|/3 -/3c|", 


along the phase transition curve as /3 —/3c, then, the exponent a is called 
the critical exponent in statistical mechanics. 

As a first step, we need to understand the asymptotic relation between 
p — Pc and f3 — Pc near the critical point {pc, Pc)- 
Along the phase transition curve, 

(126) + 

Differentiating with respect to p and using the identity T(ai; p) = T(o 2 ; p) = 
2v(d, we get 


(127) 




1 + e“i 11 


r-ai 


1+ p 


+ X 




2 / 33/2 iicg, 

1 f 


^ l + e“i dp 


1 + e“2 ^ 1 
1 + p ^ 2^ 


'logp 


1 + 

log - —ax 


1 + 


dp' 


By (126), we can rewrite (127) as 




l + e“i 11, „,,9/3 

+ --log l + e“i / 
1 + p 2 p dp 


1 ga2 11 


dp ’ 


( 128 ) 
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which implies that 


(129) 


dp 


1 1 


2/3 


1+p i+p 

log(l + e“2) - log(l + e“i) 
Tr 1 


/ /^c 


as 02 — ai —)■ 0 (and thus 01,02 —>■ Oc, (p,/3) —)• (pd^c))- 

Therefore, along the transition curve near the critical point. 


(130) 


(3-/3c = - 




1 


. /log 


{p- Pc) + 0{{p- Pcf). 


1+Pc 


This agrees with the result of (117) which gives that at the critical point, 


the slope of the phase transition curve is 

1 


(131) 


dp 


1 


P=Pc 


Pcdc 


Along the phase transition curve, we have 

(132) F{ar,p)-F{ac;pc) = 2^-2^,. 

On the one hand, 

(133) 2^ - 2^, = ^(/j _ + 0((/5 _ /3,)2) 

V Pc 

^ ^ --{p-Pc)+0{{p-p,f). 


1 




On the other hand. 


(134) F{ai]p) - F{ac\Pc) 

= [T(oi; p) - F(oi; Pc)] + [7^(ai; Pc) - F{ac] Pc)] 


1 


1 




{p - Pc) + 0{{p - Pc)'^) 


1 


+ ^^T(oc;pc)(ai - Oc)^ + 0((oi - ac)^) 
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Therefore, by ( |133[ ) and ( |134[ ) 
1 


(135) 


1 


1 1 


log 


{p - pc) + 0{{p - Pc) ) 


--(P - Pc) + 0((p - pc)^) 


1+Pc 


1 

+ g Pc)(ai - ac)^ + 0{{ai - 


which implies that 


1 


(136)- (p - pc)iai - ac) 

Pc 




1 

= Q^F{<^c]Pc){ai-acf 

+ 0 {{a - Qc)*) + 0 {{p - pcf) + 0(1/0 - pc\\ai - ad). 
Therefore, along the phase transition curve near the critical point, we have 

(137) oi - Oc ~-Odp-pd^^^ 

with 

/ \ 1/2 


(138) 


Dc = 


1 


3e° 


1 




Similarly, 

(139) 02 - ac ~ OcIp - pd^'^^ • 
Hence, we conclude that 

(140) 02 - ai ~ 2T)dp - pd^'^^. 


By (130), we also have 
(141) 02 — oi ~ 2Dc 


Pc 

y/Wc 


log 


1 + e“= 
1 + Pc 


1/2 


- 


W-P. 


Therefore, the critical exponent is 1/2. 


Remark 23. We have showed that the critical exponent is lj2 which is the 
same as in the mean field approximation. 


This result can be used to obtain the law of the approach to zero of the 
jump in the partial derivatives of the Lyapunov exponent near the critical 
point. 
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Proposition 24. Near the critical point /3 — )• /3c, p —>■ Pc, the jump discon¬ 
tinuities of the partial derivatives of the Lyapunov exponent approaeh zero 
as 

(143) a(I^) ^C2(/3-A)1/2. 

where ci , C 2 are positive real constants given by 


(144) 

(145) 


Cl 


C2 


2Dc ( Pc L l + 

/3c(l + Oc) \ V 1 + Pc / 

2Dc ( Pc L l + 

/3c(l + Oc) \\/^V ^ 1 + Pc / 


Proof. Follows immediately from the relations (94) and (93) for the partial 
derivatives, together with the result (141) for the jump of the optimizer 
variables along the critical line 02 — ai near the critical point /3 —>■ /3c. □ 


10. Generalizations 

We consider in this Section two extensions of the results presented above: 
a result for the growth rate of the positive integer moments of the random 
variable Xn, and a generalization to the linear random recursion Xj+i = 
OiXi + bi with additive i.i.d. noise 


10.1. Positive integer moments. For any positive integer g G N we have 


(146) 


E[xj] 


xlE 


'n—1 


li=0 


(1 + pe-'* 2 




= 2^^xlE 


= 


n—l 


Li=0 

n—l 

n 

Li=0 


1 1 log p+o-VFi-50-2*, ^ 




,{log p+aWi-^Pti)Yi 


where Yi are i.i.d. Binomial random variables with parameters q and Note 
that a Binomial random variable with parameters q and | can be written 
as a sum of q i.i.d. Bernoulli random variables. Therefore, we can compute 
that for any P G M, 


lim — log E 

n—^oo Tl 



n — l 
i=0 


Yi 


grlog 



(147) 
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By Mogulskii theorem, ^ ') satisfies a sample path large devi¬ 

ations principle with rate function 

(148) [ Iq{g'{x))dx, 

Jo 

where < 7 ( 0 ) = 0 , g is absolutely continuous, 0 < g' < q and the rate function 
is -|-oo otherwise and 


(149) /q(x) = sup - glog Q 


.X 


= gsup<' 0 - - log ( 

em IQ \z z 


= ql 


Following the proofs for the case (7 = 1, we get the following result. 


Theorem 25. For any g G N, X{p, (3] q) := lim„,->.oo ^ logE[xn] exists and it 

can be expressed in terms of a variational formula 

(150) 

Hp, 13', q) = sup\g{l) logp +13 [ {g{l) - g{x))‘^dx - q [ I{g'{x)/q)dx\, 
g&Qq V Jo Jo ) 


where I{x) = xlogx -|- (1 — x) log(l — x) and 

(151) 

Gq := { 5 : [ 0 , 1 ] ^ [ 0 ,^], 5 ( 0 ) = 0 , g is absolutely continuous and D < g' < q} ■ 


Remark 26. By replacing g by q - g in (150), we can express \{p,f3\q) as 

(152) 

Hp,P',q) = sup\qg{l) logp + q"^/] [ {g{l) - g{x)fdx - q [ I{g'{x))dx 
g&Q I Jo Jo 

= qX{p,ql3; 1). 


since A > 0 and q>0, where 

(153) 

^ = {g : [ 0 , 1 ] —)• [ 0 , 1 ], 5 (( 0 ) = Q, g is absolutely continuous and 0 < < l} . 


The Euler-Lagrange equation and its solutions, the phase transitions and 
critical exponents for the case q = 1 can therefore be directly applied to the 
general q G N case. 

The asymptotics (24) and (25) yield 

.. .2 

(154) 


lim 

/ 3 —>-00 


A(p,^;g) 


f3 


3 


and 


lim 

p—^OO 


Kp,P',q) - ^ - ^logp 


= 0 . 


Also, by (24) and (152), we conclude that X{p,(3-,q) grows quadratically in 
q for large q. 


lim 

q^oo 


Kp,/3',q) 

n2 


3' 


(155) 
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10.2. Lyapunov exponents for linear stochastic recursion. The re¬ 
sults for the Lyapunov exponent can be generalized to the more general 
linear stochastic recursion © Xj+i = aiXi bi where bi are i.i.d. positive 
random variables independent of (ai)^g. We will show that under very mild 
conditions on (6i)^g, we have the same Lyapunov exponent as in the = 0 
case. 

Theorem 27. For fixed q assume that E[6g] < oo. Then, 

(156) lim -logE[(xn)''] = A(p,/3;g). 

n—^oo ji 

Proof. Observe that 

(157) Xn — CLn—lXfi—l H“ 1 

= Qun— 1 ^ 71 — 2 ^ 71—2 “t“ Cin—lbn —2 H“ 1 

— 2^n—3^n—3 “1“ 1^71—2^71—3 “1“ ^77—1^71—2 “1“ ^77—1 


77—1 77 — 1 


77—1 


= Xo 


H CLi + bo Ui -|- bi ai + ■ ■ ■ + bn-20-n-l + ^n-1- 


1=0 


7=1 


7 = 2 


Since a* > 1 and 6* > 0 for any i, by Theorem 25 


(158) liminf t logE[(xn)'^] >liminftlogE 

77^00 n 77^00 Tl 


7-1 \ 9 - 


a^o H ' 

^ i=0 


= A(p,/3;g). 


77—1 


On the other hand, since Oj > 1, we get 

(159) Xn < (xq + bo + bi -\ -h bn-i) tt 

i=0 

Since (&i)^o (®*)£o independent, 

(160) E[(xn)'^] < E [(xo 6o + ^1 H-1 bn-i)''] E 


1-1 \ 11 


n 

L \i=0 


For any g G N, since the function x xi is convex, by Jensen’s inequality, 
we have 


(161) 


a^o + ^0 + ^1 + ■ ■ ■ + bn-i ^ ^ Xq + bQ + b\ ■ ■ ■ + 


n -|- 1 


n + 1 
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Hence, by Theorem |25[ we conclude that 
(162) limsup — logE[(x„)'^] 

n—^oo ^ 

< limsup - log [ E [{xo + bo + h-\ -h 6n-i)'^] E 

n^oo ^ \ 


< limsup — log [ (n + 1)^ ^ [xq + raE[5Q]] E 

n^oo 'fl \ 

= A(p,/3;g). 


n-l \ 91 

L \i=0 

n-l \ 1' 

n«*) 

L\i=0 / , 


□ 


11. Summary and conclusions 


We studied in this paper the distributional properties of a linear stochastic 
recursion of the form Xj+i = aiXi + bi. The coefficients a* have the form 
Oj = 1 + and have Markovian dependence introduced through 

their dependence on a standard Brownian motion Wi. The bi are i.i.d. 
positive definite random numbers. 

The main results of the paper concern the rate of growth of the positive 
integer moments of the variable Xn- We show that the rate of growth of 
these moments, or Lyapunov exponents, defined as the limit 

(163) \q{p,/3)= lim - logE[(xn)''] , gGN, 

n^oo Ti 


exists and is finite as n —)■ oo, at fixed /? = The function \q{p,j5) 

can be computed explicitly using large deviations theory and is given by 
the solution of a variational problem for a functional A[/]. We solve the 
variational problem and reduce it to the problem of finding the extremum of 
a real function defined in terms of a one-dimensional integral. The Lyapunov 
exponents for g G N can be related to the Lyapunov exponent of the first 


moment g = 1 as shown in Theorem 25 


The solution of the variational problem shows that the Lyapunov ex¬ 
ponents have non-analytical dependence on the parameters (p,/?), which 
is similar to a phase transition in statistical mechanics. For p < pc, be¬ 
low a critical value pc, the Lyapunov exponents Xq{p,l3) have discontinuous 
derivatives along a curve in the (p, /?) plane, ending at a critical point (pc, /3c). 
Along this curve the Lyapunov exponents have a first order phase transition, 
and at the critical point the transition is second order. 

The variational problem resulting from the application of large devia¬ 
tions theory has a direct physical interpretation, as the thermodynamical 
potential of a one-dimensional gas of particles, interacting with attractive 
two-body interaction energy given by the covariance function of the stan¬ 
dard Brownian motion. The results of our paper give an exact solution 
of this statistical mechanics problem in the grand canonical ensemble, and 
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demonstrate the presence of a phase transition in this system. The ther¬ 
modynamical properties are in agreement with the solution of a lattice gas 
with the same interaction in the thermodynamical limit, obtained in the 
isobaric-isothermal ensemble m- 

As mentioned, the random multiplicative process for Xn can be inter¬ 
preted as the grand partition function of a 1-dimensional lattice gas placed 
in a random external field given by a standard Brownian motion. This is 
a lattice gas equivalent of the systems studied in [niinKii] in the contin¬ 
uous case. Our results give the asymptotics of the moments of the grand 
partition function, which could be used to determine the properties of the 
disordered system in the quenched approximation by an application of the 
replica approach m- 

We note that similar moment explosions have been studied for the solu¬ 
tions of the diffusion and Schrodinger equations in a random medium given 
by the square of a Gaussian random field mm- 

The results of this paper have applications to the numerical simulation 
of stochastic differential equations. Euler discretization of certain stochastic 
differential equations gives linear stochastic recursions of the form consid¬ 
ered here. The weak convergence of the discretization requires the uniform 
boundedness of the moments of the discretized variable, see for example [2] . 
Similar recursions are obtained when considering the Euler discretization 
of stochastic volatility models with log-normally distributed volatility. The 
results of this paper give explicit results for the growth rate of the moments 
of the stochastic variable Xn in such models. We will present detailed appli¬ 
cation of these results and methods to models of practical interest in future 
work. 


Appendix A. Solution of the Euler-Lagrange equation 

We present in this Appendix the solution of the Euler-Lagrange equation 
( [6^ for h{y). It is useful to introduce the notation 

(164) V{h) = 2plog{l + e^). 

In terms of this function, the equation ( |69| ) is written as 

(165) h"{y) = -V'ihiy)), 


which is analogous to Newton’s law for a particle moving in the potential 
V(h). Written in this form, it is easy to check that the following combination 


is a constant of motion of the equation (69) 


(166) 


E = l{h\y)f + V{h{y)) = V{h{l)). 


The value of the constant of motion was determined from the boundary 


condition (70) at y = 1 as E = V{h{l)). 
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The relation (166) will be useful to express h'{y) in terms of h{y). In 
particular, we can use it to write 

dy 1 11 

^ “ ^2{E - V{h{^ ~ 


(167) 




Integrating this relation over h from /i(0) to h{l) we get an equation for /i(l) 

1 dx 

Jh{0)=logp 


(168) 


1 = 


logJig? 


(169) 


Thus we can find /i(l) by solving the equation 

dx 


F{h{l);p)^ 


llogp 






Once h{l) is found, the complete shape of the function h{y) can be de¬ 
termined by solving the equation 

(170) / -^== = 2y^y. 

Jloi 


llogp 


logiigil 


As the next step in the solution of the variational problem we would like 
to compute the functional A[/] corresponding to a solution f{x) of the Euler- 
Lagrange equation (62) with boundary condition (|63|) . If the Euler-Lagrange 


equation has a unique solution f{y), then X{p,(3) = A[/]. However, if it has 
several solutions, as is the case around the phase transition, the Lyapunov 
exponent is given by the supremum of A[/] over these multiple solutions 

(171) A(/9,/3) = supjA[/]. 

The main result is summarized in Proposition |10[ We present here the proof 
of this result. 

Proof. We start by expressing the functional A[/] in a simpler form as 

(172) 


Mf] = \^ogpj^ dxf{x)-^j^ dxf{x) log 


- / dxlog{l - f{x)) 
Jo 


This is obtained by eliminating the double integral over K(z,y) using the 
Euler-Lagrange equation (59). Multiplying this equation with /(y) and in¬ 
tegrating over y, this allows us to solve for the double integral. Substituting 
into (58) gives the result above. 

There are three integrals appearing in A[/]. We will show next that their 
sum can be expressed in terms of h{l) alone. We consider them in turn. 
The first integral is related to /'(O) as 

(173) /'(O) = 2/3/(0)(l - /(O)) [ dzfiz) = [ dzf{z). 


{l + pf 


1 
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This is obtained by taking y = 0 in (61). This is uniquely determined by 
/i(l), as can be seen from equation (166) 


(174) 


\{h'{y)f + V{h{y)) = V{h{l)) 


and thus h'{y) = ^2{V{h{l)) - V{h{y)) = 2\/^Y^log Taking here 

y = 0 we can express /i'(0) in terms of h{l). As a result we have 


1 


1 


(175) Jo = dxf{x) = ^ 


1 + 


I log 


1 + P 


The second integral in A[/] is 


fix) 


(176) h= dxf{x)log ^ - I 

Jo 1 - fix) Jo 

1 

~~Wjo 


= / dxh{x) 


gh{x) 

1 + 


dxh{x)h"{x) ~ ^(y dx{h'{x))"^ + h{{))h', 


where we integrated by parts in the last step and used h' {1) = 0. 
Finally, the third integral is 


(177) 


h = [ dx log{l — f (x)) = — f dxlog(l + 

Jo Jo 

= -log(l + e'*(^)) + ^y dy{h'{y))‘^, 


where V{h) is defined in (164). In the second line we used (166) to eliminate 
Vihiy)) in terms of (/i'(y))2 = 4/3logl±^. 

The integrals Ii and I 2 appear in A[/] in the combination 


(178) 

1 


1 




dx\l(h'(x)f - r(/i(i))} + ih(0)/i'(0) 


1 rm 

7^ 


dx\ log 


logp 


1 _1_ ph{l) I 

- log(l + + — logph'(O). 


Substituting this into (172) the last term cancels against the term pro¬ 
portional to the integral Iq, and we obtain the result ( [tT] ). This concludes 
the proof of ( [tT] ). □ 
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Appendix B. Analytical solution for j3(f > 1 


We present in this Appendix an analytical solution of the variational 
problem for A(d) in the [3d? —>■ oo limit. This is used to derive the prop¬ 
erties of the phase transition in the same limit, which are summarized in 
Proposition [TT| 

We will prove here the following approximation for the functional A.{d) 

(179) A{d) = jdd^ - \l3d^ + dlog ( 7 ^) + log(l + p) + o{a~^), 

3 V1 -I- p/ 

where a = [dd?. 

The starting point is the observation that the integral appearing in (76) 
depends only on the combination a = We denote it as 


(180) 


J{a;p) = 


y^dy 


1 + p- 


We would like to obtain an approximation for this integral for a 3> 1. This 
is given by the following result. 


Lemma 28. The integral J{a; p) has the following expansion for a S> 1 


(181) 


J(a;p) = 


1 + p 


Proof. This result is shown by proving matching lower and upper bounds 
for the integral J(a; p). We start by deriving a lower bound for the integral. 
This bound follows from using the inequality — 1 > 2(y — 1), which holds 
for any y G ( 0 , 1 ), in the exponent in the denominator of the integral (180). 
Then the integral can be performed exactly with the result 


(182) 


1 




i + P 


3t- 

+ ^Li3 


l + P 


+ P' 

- ^Li3 


o—2a 


1 + /0 


)} 


Here Li„(z) denotes the polylogarithm of order n [T]. 

For p —)• 0 and a S> 1 the polylogarithms approach constant values 

^2 


lim Li 2 

p—>0 


(183) 

(184) 

(185) 

We get thus the lower bound 


lim Li 3 

p->0 


1 

1 + P 
1 

1 + p 


lim Li 3 (x) = X + o(x^) . 


vr 

“ y 

= C(3) ~ 1.202 
2\ 
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Next we prove the upper bound for the integral J{a;p) 


(187) 


J{a;p) < 


1 


— log 
l + pl3 2a ^ 


P 




1 + p - e' 

This is obtained by considering the difference 

1 1 1 
1 + p - I + p ~ {I + p)[{l + p)e<^-y^) - 1] 

Multiplying with and integrating over y : (0,1) we have 

1 ' ^ 

/o 


(189) J(a;p)- 


1 


2a(l + p) 


3(1+ p) 

log 


< 


1 + P 
P 


1 + p- e- 


{1 + p)e'=^(^-y^) - 1 

1 

< ... , -7 log 


2a(l + p) V1 + p 


This proves the upper bound (187). Comparing with the lower bound (186) 


we obtain the expansion (181). 


□ 


The final result (179) follows directly from using the expansion (181) of 
the integral J(a; p) into the expression for A(d). 

We use next the approximation (179) to study the solution of the varia¬ 
tional problem for A{d) for /3 —>■ oo. We would like to find the supremum 
over d of the cubic polynomial in (179). This supremum is reached at d = 0 


or d* = 2 (^1 -|- Y^l -)- ^ log > 0. according to the following condition 
(190) sup^A(d) = 


A(0) = log(l -h p) 
A(d*) > log(l p) 


if/3<-ilogT^ 


The supremum switches branches at the point 


PcAp) = - ^log 


P 


(191) 3 - 0 VI + P 

which thus defines the phase transition curve for fd 
result (79). As /3 —>■ 00 or equivalently p 


00 . This proves the 
0, the slope of this curve in 


(—log/9,/3) coordinates approaches the value 8/3. This is smaller than the 
slope of the phase transition curve in the mean-held approximation, which 
is equal to 3. 

The values of di , ^2 along the phase transition curve approach 


(192) 


di = 0, 


da = - = 0.75 


as (d ^ 00 . This proves the result (78). For jd S> (daip), we have lim^_^oo d = 
1_ and the Lyapunov exponent becomes 


(193) 


lim \{p, fd) = lim A(d) = \ld + log p. 
0^00 0^00 3 


This result is in agreement with the large [d asymptotic behavior of the 
Lyapunov exponent proven in Proposition]^ see Eq. (24). 
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